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Approaches to Research on the Improvement of Postsecondary Teaching and Learning 



Introduction 



The National Center for Research to Improve 
Postsecondary Teaching and Learning 
(NCRIPTAL) is a research center funded from 
1986- 1990 by the Office of Educational Research 
and Improvement of the U.S. Department of 
Education. NCRIPTAL is focusing Its research, 
development, and dissemination activities on five 
aspects of coU^e environments that affect learner 
outcomes: (1) classroom learning and teaching 
strategies. (2) curricular structure and integra- 
tion. (3) faculty 2^titudes and teaching behaviors. 
(4) organizational pi-actices. and (5) tiie use of 
emerging infomiation technology. In addition to 
its own research efforts. NCRIPTAL is charged 
with providing national leadership for other 
researchers concerned with the improvement of 
postsecondary teaching and learning. This 
leadership role inc. tdes 



1. Encouraging discussion about needed re- 
search that extends beyond NCRJPTAL's 
immediate scope and budget. 

2. Promoting the interchange of ideas among 
researchers, and. 

3. Providing technical advice to institutions 
undertaking self-improvement efforts. 

As appropriate to a recently established 
National Center, this paper alms at the first two 
of these three goals. Its purpose is to stimulate 
reflection about research approaches and to 
promote recognition of the complexity of the 
Issues involved and the variety of approacnes that 
might be taken. 
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I. Research to Improve Teaching and Learning 



^^jyl^hy is Improvement Needed? 

During the 1980s discussion about educa- 
tion has shifted from issues of access and equal- 
ity toward a concern with realizing the potential 
for achievement among students at all levels of 
preparation and ability. Reports of declines in 
achievement among degree recipients, as meas- 
ured by graduate and professional school en- 
trance examinations, have followed earlier reports 
of insufficient preparation among entering college 
students. As a result, many public representa- 
tives, including governors and state legk>lators. 
believe that academic deficiencies of students who 
enter college with limited preparation have not 
been remedied by the time of graduation. Fur- 
thermore, even for students well-prepared for col- 
lege, today's coDege experience Is sometimes char- 
acterized as firagmentttl rather than coherent (As- 
sociation of American Collies. 1985). narrowing 
rather than broadening (Bennett, 1984). and 
vapid rather than engaging for students (NIE 
Study Group, 1984) As a result there is wide- 
spread discussion about the meaning of "excel- 
lence" in postsecondary education and the varied 
routes to its achievement. 

In such a climate, both new research and 
new policies can assist in restoring crediblllly and 
accountability in coUegiat^ education. Since the 
approaches employed by both researchers and 
policy-makers are determined by the Issues 
addressed and the specific questions asked, it is 
essential to determine the assumptions concern- 
ing the sources of current problem areas in 
teaching and Iwdmlng. For example, are the 
primary problems to be solved (1) in the activity of 
teaching or learning, (2) Mth the actors involved 
in teaching and learning. (3] in the organizations 
supporting the actors and processes, or perhaps. 
(4) in the definition of what is to be learned? If 
Improvement is needed in each of these four 
areas, what research models are most likely to be 
useful? What current mechanisms are available 
to execute this research? 

While making no claim to have identified all 
possible issues or approaches, in this paper we 
explore some of the underlying questions in- 
voh^ed. First we describe several potential inter- 
vention points for in .proving teaching and learn- 
ing. Second, we present a description of the types 
of reseaich commonly employed to study these 
problems and infomi impro^^cment eflbrts. Third, 
we Juxtapose the list of possible intervention 



points and the existing types of res :arch to 
suggest that particular research agencies, typi- 
cally employing dUDferent approaches, are best 
equipped to pursue various aspects of the prob- 
lem. Finally, we suggest how the various re- 
search agencies might work together to inform 
and enhance each other's efforts. 

Potential Targets for Imp ovement 

One appn ach to the complex problem of im- 
provement is to 3t\idy the activities of teaching 
and learning. Learning and teaching can be 
viewed as distinct activities, each amenable to 
research and improvement. Another possibility is 
to view teaching and learning as mutually de- 
pendent, exploring how changes in one affect 
changes in the other. In either case, considerable 
effort is needed to better understand how formal 
education takes place and to use such knowledge 
to bring about improvement. To define and clarify 
productive learning processes or strategies and to 
describe more fi iy what constitutes effective 
teaching are important research agendas. 

Another approach is to focus on the actors 
rather than on the activity. If postsecondary 
teaching and learning is not meeting public 
expectations, perhaps the problem is not in the 
process but in the characteristics of teachers and 
learners themselves. Student motivation, involve- 
ment, ability, and preparation all have an Impact 
on the way in which students engage themselves 
in learning. Similarly, faculty preparation, moti- 
vation, and sense of task may shape the teaching- 
learning process. 

An alternative formulation of the problem is 
that the organized delivery system for teaching 
and learning in postsecondary institutions is 
faulty. Teaching and learning are. in a crude 
sense, products of formal organizations which 
serve as societal gatekeepers to professions, occu- 
pations, and future lifestyles. It may be that 
research on improving teaching and learning 
should focus on the Institutions society has 
created and their impact on both actors and 
activities. 

Finally, the problem may be in lack of 
consensus of what Is to be taught or learned. The 
definition of what is to be learned is a boundary 
issue between higher education and society. In 
some cases, administrator, faculty, students, and 
employers have different and not readily compat- 
ible views on what Is important for students to 
learn. The problem of apparent lack of consensus 
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Is exacerbated by long- standing neglect of ways to 
measure learning. 

Types of Research 

When considering possible problem areas, 
and consequently targets for intervention or im- 
provement, we must also consider the types of 
research which might be used to investigate these 
topics. For the sake of discussion, we outline four 
interrelated types of research: basic research, in- 
stitutional research, policy analysis, and evalu- 
ation. Although these research approaches are 
sometimes confused in public discussions, each 
is distinctive and will likely play a unique role in 
informing improvement efforts. 

Basic research on teaching and learning 
typically is carried out by independent or collabo- 
rating researchers from fields such as psychology 
and ^ucation. although it is sometimes under- 
taken by various disciplinary groups or individual 
faculty members. The primary purpose of basic 
research is to better understand the processes of 
teaching and learning and the various influence's 
on them. Since the ultimate goal of basic re- 
search is to discover causal relationships, che 
research methods chosen typically are explora- 
tory, correlational, and experimental. The results 
of this research usually appear in scholarly 
Journals, often without clearly stated implications 
for change. 

Institutional research usually refers to 
studies directed and carried out by colleges 
attempting to understand and improve their own 
actors and activities. Most large colleges and 
universities maintain offices to conduct institu- 
tional studies and many small colleges conduct 
such studies on an ad hoc basis. For a variety of 
historical reasons, relatively little institutional 
research has focused on the teaching and learn- 
ing processes or their outcomes and relatively few 
institutional research offices employ persormel 
whose primary interests are in these areas. Most 
studies conducted by institutional research units 
within colleges are descriptive or correlational, 
and since they are designed for local use, reports 
are not widely circulated. 

Policy analysis may be considered research 
that examines and weighs alternative practices 
and strategies that one or more institutions might 
pursue The analysis may be carried out at many 
levels, for example, by institutional administra- 
tors, faculty or administrative committees, or by 
superordinate groups such as state coordinating 
agencies or legislatures. In its most complete 
form, the analysis will collate and draw on results 
from both basic and institutional research, sug- 
gesting how Institutional practices must or might 



change in a desired direction Consequently, 
while policy analysis ultimately may be based on 
descriptive, ccrrelational. or experimental infor- 
mation, it Is a analytical technique which asserts 
that, based on the evidence, selected strategies 
may be most likely to produce certain desired 
results. Reports of policy research are cften 
circulated widely but the sources on which they 
draw and the basis on which alternatives are 
chosen are not always made clear. 

Evaluation is a specialized foim of research 
that examines the results of existmg strategies or 
policies to determine if intended or unintended 
outcomes actually can be attributed to them. As 
such, evaluation typically implies judgments 
about the success of various strategies and 
makes recommendations about their continu- 
ation. Evaluative research may be used to learn 
more about the effects of implementing strategies 
derived from the other types of research— basic 
esearch, institutional research, or policy analy- 
sis. The evaluation may be undertaken by inde- 
pendent researchers, by institutional research 
units, by other imits within institutions, or by 
agencies v/ith policy responsibilities. The meth- 
ods used are often eclectic and frequently con- 
sider the values and interests of various stake- 
holders. The extent to which research reports are 
available and the extent to which they may be 
clear about their methods depends upon both the 
scope of responsibility and the public accounta- 
bility of the sponsor. 

Arguably, then, a successful program of 
research for improving teaching and learning 
must consider the potential contributions of all 
four types of research. Ideally, the policy analysts 
would weigh their decisions against knowledge 
produced by both basic and institutional re- 
searchers while the evaluative researcher would 
help to supply new and refined questions for both 
these groups and for policy analysts. This poten- 
tial relationship, which currently does not operate 
ideally for many segments of higher education, is 
diagrammed in Figure 1. 

An Integitited Strategy for Productive Research 

The strengths and weaioiess of each type of 
research, as well as specific approaches, may 
influence both the nature and use of research. To 
facilitate consideration of the current status of 
research on postsecondary teaching and learning, 
we have created a matrix (Table 1) from the four 
primary types of research and the potential points 
of attack on the problem of improving teaching 
and learning that have been described. In the 
subsequent discussion, we assess research 
activities, trends, and roles at each of the inter- 
vention points. 
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Basic 
Research 



I 



Institutional 
Rese8''ch 



Understanding 
or Prediction 



Policy 
Analysis 



Application 



Evaluation 
Research 



Confirmation 
or Revision 



Figure 1. Ideal relationship among existing types of research. 



TABLE 1 

Locus of ResMirch to Improve Teaching and Learning 



INTERVENTION 
POINT 


BASIC 
RESEARCH 


INSTrTUTfONAL 
RESEARCH 


POLICY 
ANALYSIS 


EVALUATION 
RESEARCH 


1a. Activity: 

Learning 










1b Activity 

Teaching 










2a Actors 

Learners 










2b Actors 

Teachers 








3 Organization 










4 Learning 
Content 
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II. The Activity - Learning 



If we are to improve learning, we must first 
understand what it is and how it takes place. 
Traditionally, the concept of learning as an activ- 
ity has been intricately intertwined with the 
varied purposes of learning: personal develop- 
ment, social development, intellectual or cognitive 
development and developuicnt of skills for eco- 
nomic self-sufficiency. To achieve these purposes 
while in college, wc typically expect students to 
acquire personal and social self-confldcnce and 
responsibility, to assimilate a body of knowledge, 
to gain appreciation for the shared meanings of a 
cultural heritage, to Icam to thLik critically and 
engage in reasoned discourse, and often to de- 
velc ^ marketable skills. Lack of consensus about 
prlodty among these goals and occasionally the 
assignment of responsibility for them to different 
divisions of educational institutions has obscured 
the commonality among them- namely, that all 
involve changes in the learners' ways of thinldng 
and behaving. 

Current * asic research on learning, however, 
attempts to deilne and conceptualize across types 
of learning, the processes by which individuals 
amass information and compare, sort, evaluate, 
and apply this information in appropriate or novel 
ways. These processes arc believed to occur 
whether the learner is engaging in a new voca- 
tional experience, a new personal/social experi- 
ence, or an experience desired to foster intellec- 
tual growth. Three approaches within the field of 
cognitive psychology are directly relevant to 
educaUonal research: cognitive prjcessing mod- 
els, cognitive developmental stage models, and 
experimental models of motivation and cognition. 

The key factors in an Information- processing 
model of student learning— cognitive factors, 
problem-solving abilities, knowledge representa- 
tion and learning strate^es- may be mediated by 
motivational factors such as student anxiety and 
attribuUonal styles (McKeachie. et al.. 1986). 
Currently, many researchers believe that the 
cognitive factors can be altered through instruc- 
tion, thus, students can learn to learn. The key 
question is how to help them do so. 

Another concept within cognitive psychology 
is the idea that Intellectual development proceeds 
in stages. Recent work by Case (1985) continues 
the tradition pioneered by Piaget. •Vectors* of 
cognitive development are hierarchically struc- 
tured with each based on thorough assimilation 
of the previous. In higher education. Perry has 
suggested a similar framework although with 
different elements (1970). In such a research 



tradiUon, the quesUons become identifying and 
facilitating movement from one stage of intellec- 
tual development to another. 

Within cognitive psychology, there Is also a 
growing body of literature that attempts to estab- 
lish the relationship between affect and cognition. 
Zajonc (1980) has suggested that •'pure*' cognition 
may not exist. In this view the storage and re- 
trieval capabilities of the mind are based on 
affective factors, not abstract knowledge struc- 
tures. Thus, when asked about a book or issue, a 
person will first reply with how he or she felt 
about it and only then will be able to recall more 
specific content. In this paradigm, all knowledge 
is stored with affective "tags", y^plication of this 
model to educational research would lead us to 
explore the affective components of the learning 
situation to understand how information learned 
would be triggered and used in future settings. 
Such explorations have broad implications for 
involving students in their learning experiences 
as well as for developing continued motivation to 
undertake new learning. 

A different but also promising area of re- 
search on learning stems from research on the 
functioning of the human brain. Ongoing studies 
of the role and pathways of neurotransmitters 
may aid us In distinguishing and categorizing 
modes of thinking and learning. Are the patterns 
of brain activity the same when constructing an 
algorithm for a computer program as when 
analyziiag the structure of a Mozart symphony? 
Such an approach is obviousty quite different 
from traditional categorizations of learning that 
are related to societal purposes. 

Clearly, models such as these, which se^k to 
understand the nature of learning, lie within the 
realm of basic research, typically in psychology or 
neuroscience. The exploration of these ideas is 
slow and painstaking and is undertaken by 
specialized researchers. Little work is done by 
college institutional research offices on basic 
learning strategies or student learning pattems. 
Policy makers find the emerging research difficult 
to assess and understand. Thus, application and 
field testing are slow to develop. 

One application of the cognitive psychology 
models is to use emeiging knowledge of the ways 
in which people think and learn to structure and 
sequence material for leaming. The concept of 
•^mastery leaming" can be seen as such an appli- 
cation. It is premised on the notion that there is 
a hierarchy of concepts, or that related concepts 
can be sequenced so as to expedite Information 
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processing, thus minimizing individual student 
differences in ability to organize and remember 
information. 

A related approach is to use knowledge 
about teaming to ^'flfect change in the individual 
students. The possibility exists that students can 
be exposed lo these principles and processes and 
thereby Ix ' jght how to learn. 

One ai vrar.tage conceptualizing learning 
? ~ distinct activity is that derive J principles 

be tested outside the classroom. The grow- 
tng importance of information technology cn the 
campus offers an opportunity to explore in detail 
the intersection between the substantive content 
to be learned and the fomal thought structures 
requisite to the learning tasks. Future research 
on learning will undoubtedly be informed and 
altered by current research in information tech- 
nology ^^d artificial intelligence. Although we 
may be moving closer to imderstanding how 
hur ' process and represent information, we 
are still a long way from understanding how 
understanding is achieved. 

OccaslonaJly an idea from basic research 
emerges into public view and is adopted as a 
panacea, usually with considerable disappoint- 
ment. In cases where policy analysis has been 



based on basic rese&rci findings, decisions are 
generally made to incorporate one of the basic 

laige scale way on a given campus. Evaluation 
research may then become difllcult or impossible 
because of the absence of comparable learning 
experiences in other modes. Altematlvely, poli- 
cies may be made to apply certain treatments, 
such as those to teach learning strategies, to 
students with particular deficiencies. In such 
cases, the special selection of target groups and 
the absence of randomized control groups has 
hampered the feedback ^rom application settings 
and has Umited field testing of developments 
emerging irom basic research. Finally, because 
colleges and universities have focused on cogni- 
tive development for young aiults who simultane- 
ously are establishing their personal and social 
identities, the application of learning principles to 
development of adults and thase seeldng eco- 
nomic self- sufficiency has rei^ained underdevel- 
op<!d. Despite such imderdevelopment of basic 
ref.earch, speculpitive policies and evaluative 
research concermjig vocational learning abound 
in order to meet societal changes that have not 
yet been fully recognized by researchers. In such 
a case, evaluative research may precede and drive 
bas^c research rather than the reverse. 
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III. The Activity - Teaching 



If we arc dissatisfied with student learning in 
colleges, one source of Uie problem might be 
that we do not know what constitutes elTective 
teaching or how to ensure that it takes place. The 
process of teaching is difficult to study as an 
abstraction. While it is easy to imagin's someone 
learning without a teacher present, it Is hard to 
Imagine teaching without reference to learning. 
Thus, while learning may be studied as a process 
in its own right, teaching either foraially or infor- 
mally involves a learner. 

One place to begin research on teaching Is to 
deflnemajor dimensions of the task. At least four 
dimensions might be considered: (1) transmitting 
knowledge; (2) motivating students to learn; (3) 
selecting and organizing facts, concepts, prin- 
ciples. sWlls and attitudes to be introduced; and 
(4) serving as a formal or Informal role model for 
students. 

Most of the existing research has focused on 
the first dimension, evaluating the eflfectiveness of 
various instructional modes (e.g.. lecture, discus- 
sion, directed experience, etc.). Results of this 
research suggest that "effectiveness" can best be 
evaluated with reference to instructional objec- 
tives. Since each mode achieves different objec- 
tives, no single mode can be cited as clearly 
superior. 

The ability of various teaching strategies to 
motivate student learning has been the subject of 
much debate. Recently both policy groups and 
researchers have uiged the adoption of teaching 
strategies that promote "active" rather than 
"passive" learning (NIE. 1984; Astln. 1985). The 
assumption behind this perspective is that teacli- 
Ing should encourage appreciation of the sub- 
stantive content and promote the development of 
student curiosity that might fr-.:-ihtate further 
inquiiy. In short, teachers are seen as evangel- 
ists for learning and not mero presenters of 
encyclopedic knowledge. A difficulty with this 
view is that there is little information about the 
extent to which teaching can be seen as mission- 
ary when the diversity of student goals and 
purposes is left unexamined. Indeed, it may be in 
this area of student motivation and effort rather 
than in teaching or learning strategies where the 
purposefiilness of education for the student is 
essential to the success of teaching. 

The third dimension of teaching, the organi- 
zation and se4dencing of the information pre- 
sented in college classrooms, has received little 
systematic attention. What elements do faculty 



members consider when structuring a course? 
What influences their decisions? Considerable 
work on teacher thought processes both when 
plarming and directing learning has been begun 
by K-12 school researchers in Sie last several 
years but little such research has been done at 
the college level (Stark & Lowther, 1986). Rather, 
it is merely assimied that college teachers "teach 
as they were taught" and that little can be done 
about engaging their consideration of alternatives. 
Yet we do know that students who evaluate 
teaching consider teachers who appear well-pre- 
pared and well-organized as eff^ectlve. 

The fourth dimension, the teacher as role 
model, has been aknost totally Ignored except for 
a scattered studies of "mentoring- that tyi)ically 
invohre relationships at the post-baccalaureate 
level. Yet, anecdotal evidence indicates that the 
"great teacher^ influence is not a myth. Further, 
a great deal of research holds that interaction 
between faculty and students diflerentiates 
between students who stay in college and those 
who leave, between those who are satisfied with 
the college experience and those who are dis- 
gruntled. Seemingly, the task of serving as a role 
moocl is closely related to the task of becoming a 
motivator of students. The lack of distinction 
between these two tasks, as v.ell as lack of recog- 
nition that teaching may be both formal and 
informal, may account for the neglect of this 
dimension. 

In contrast to research on learning, the 
majority of research on postsecondary teaching 
has been of an applied, rather than basic, nature. 
Superficially, at least, the act of teaching is more 
directly observable than the act of learning. 
Thus, institutional research efforts frequently 
include descriptions of teaching in a given institu- 
tion. Such descriptions typically are limited, 
however, to the demography of the ir.structional 
sc*^ne— number of courses, size of classes, mode 
of instruction. The teaching process itself has 
been considered private and not open to investi- 
gation. If basic psychological or sociological 
underplrmings of teacher thought processes exist, 
as they surety must, they have not yet been iden- 
tified nor have they become the province of any 
discipline for basic research. Perhaps as a conse- 
quence, policy analysts have felt somewhat more 
free to formulate recommendations based on the 
limited appUed research in this area than is the 
case for complex basic research on learning. 
Once policy decisions have been formulated, 
evaluation is seldom undertaken. 
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!V. The Actors - Learners 



When trying to understand difficulties in 
the teachlng-leamlng process, one obvious 
question to ask is "Who are the learners?". In 
truth, the bulk of our understanding of teaching 
and learning stems from research on individual 
students. While this research covers a vast spec 
trum of discrete topics, research on individual 
learners might be classified as following two 
distinct approaches. The first approach, often 
using large-scale survey data, attempts to de- 
scribe successful leamers and identify the corre- 
lates of that success. The second is concerned 
with underatandlng student learning in relation 
to student Identity, placing the learning experi- 
ence in the context of students' past abilities and 
perceived futures. 

What is it about some students that allows 
them to succeed at the tasks society defines for 
them? Surveys, analyses of achievement test 
scores, and case studies have been used to try to 
identify what makes a successful learner. Im- 
plicit in this approach is the notion tliat if we 
understand the characteristics that breed suc- 
cess, we can promote the development of these 
characteristics. This notion is challenged 
some; for example. Cross (1986) points out that 
many of the characteristics thus identified are not 
variables within the purview of the college to 
change. Nonetheless, many major cross sectional 
surveys of college students have attempted to 
isolate the affective and behavioral correlates of 
academic success as well as the sociological 
correlates. 

One major example of this type of work is the 
research conducted on the CIRP data and re- 
ported by Astin (1979). Astin found that invohrc- 
ment in campus activities, part-time campus 
employment, and on-campus residence are a few 
of the variables positively related to academic 
achievement. In a subsequent work, Astin con- 
cludes that "involvement* in college life is the key 
component which distinguishes successful stu- 
dents from those less academicalfy successful 
(1985). Similar approaches are taken by Pace 
(1979), who concludes from his own studies and 
others* that students learn what they study and 
grow proportionately to the efforts they exert. 
Fmally, in examining predictors of student suc- 
cess in nine colleges. Willingham (1985) con- 
cluded that a personal quality he called **produc- 
tivity.'* seemingly undergirded by personal energy 
and perseverance, is a key factor in college suc- 
cess. 
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One advantage of identifying characteristics 
of learner success is that it provides concrete in- 
formation on a laiiger number of persons than 
would be possible through mere observation. 
Another advantage is that it is amenable to use 
by colleges and can thus take into account their 
unique missions, characteristics, and student 
clienteles. A disadvantage is that the persorial 
and social context of the process of learning is 
excluded when the student is one case in a 
survey. While surveys suggest important areas of 
concem. and somettoes impty interventions, they 
do not offier much information on the dynamics 
and context of such appealing constructs as 
"invohrement." '•quality of eff^ort." or "productivity" 
to be useful in advocating concrete strategies for 
intervention with particular types of students. 

A modification to the searc h for universal 
characteristics is to identify individual differences 
among leamers. By recognizing special popula- 
tloiis. researchers can begin to specify models of 
achievement and learning across subgroups and 
examine the meaning of these differences in 
relation to student success. This approach is. at 
least in part, congruent with issues in the infor- 
mation-processing view of learning that sees 
learning as the integration of new knowledge with 
that already possessed. Again, using an earlier 
example, the notions of student Involvement and 
productivity may be quite different for younger 
than for older students, for minority than for 
majority students, and for vocationally oriented 
students than for socially oriented students. 
Examination of these subgroups can lead toward 
a making such constructs more concrete. Many 
such studies are underway both as subsidiaries 
of large surveys and within individual colleges. 

A related line of inquiry that is not pursued 
as actively is the study of student cohorts in the 
broader historical context of the real or perceived 
constraints and opportunities of the employment 
market. The meaning and purpose of college for 
students, generally or by subgroups, may be very 
different in different economic eras. Ix)ngitudinal 
studies have not been used extensively to exam- 
ine the societal consti-aints on student learning 
experiences. 

A far different perspective on individual 
leamers is gained by questioning the meaning of 
learning in the context of students* own lives. 
Instead of asking *Who are the leamers?" the 
question becomes "What Is the meaning of learn- 
ing for the students?". This type of questioning is 
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exemplliled by research ranging from Cnlckerlng s 
synthesis In Education and Identity [1969] to 
Pen>' S compendium of obscrv-aUons in Intellec- 
tual and Ethical Development of College Students 
(1970) and. more recently. Careerism and Intel 
lectvalism Among College Students (1985). a 
study of college student goals and purposes st a 
single university. In this approach college learn- 
ing is seen as an event in an individual's life 
history. Not only the students* socioeconomic or 
demographic characteristics but their motiva- 
tions, feelings of self-efflcacy. expectations of 
success, and attributions are viewed as crltiral 
detennlnants of the learning experience. 

An Interesting question suf^gested by thLs 
perspective is To what extent do (can) students 
develop self-identities as learners?" Researchers 
in social p^rchology recently have been engaged 
in sii^dles to define and measure lndl\idu^ "sche - 
mata**. or cognitive generalizations about the self, 
for various social roles (Markus. 1977). Applica- 
tion of this t3rpe of research might aid in imder- 
standing the extent to which students incorporate 
a sense of ^Jieir ability to learn into their larger 
identity and the Impact of such incorporation on 
learning outcomes. 

Survey research of an ex post facto or longi- 
tudinal nature has usualty been conducted by 
those who see themseh^s as basic researchers 
engaged in descriptive and correlational studies. 
Less frequently, and possibly with less sophistica- 



tion, fiurvey research has also been conducted by 
on-campus institutional research offices. In 
eithe*' case, policy analysis drawing on such 
findi ngs has Just begun to emerge. For example, 
the national report lnxx)lvement in Learning (NIE 
Stuc y Group. 1984) may be viewed as policy 
research drawing upon more basic local and 
national studies. The study of student character- 
istic 5 and the derivation of policy implications has 
develoF)ed to the stage where evaluation research 
will be needed to confirm or revise these notions 
in light of intervention strategies they suggest. 
An important element of the success of such re- 
search is examination of the extent to which 
appropriate and substantiated interventions can 
be imdertaken for particular subgroups of stu- 
dents and subsequently assessed. 

In contrast, exploration of the meaning of 
education for students is seldom imdertaken by 
institutional researchers. Such studies are most 
frequently driven by desire for deeper under- 
standing of human experience. Their time- 
constmiing and expensive execution is limited to 
basic researchers In the social and behavioral 
sciences. While such research seldom attracts 
the attention of policy analysts, on those occa- 
sions when it does, a humanistic, anecdotal pres- 
entation mode may provide considerable appeal. 
Because of the indlviduallstk; and ethnographic 
nature of these basic Investigations, evaluative 
research is infrequently conducted. 
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V. The Actors - Teachers 



For most questions one may ask about 
learners, a parallel question may be asked 
about teachers. What differentiates the success- 
ful teacher from those less successful? What is 
the meaning of teaching for teachers? What 
promotes their "involvement." "quality of effort," 
or "productivity"? 

Although demographic descriptions of the 
college faculty abound, efforts to determine which 
faculty are successful teachers are limited by the 
lack of consensus on criteria to be used. In the 
sense that masses of correlational data exist 
with'^ institutional flies, evaluative studies of 
teaching by students parallel quite closely the 
massive surveys of students educational 
researchers. The rather consistent factors emeig- 
Ing from stv'jnt evaluations reveal what students 
like m teacncrs. However, these surveys do not 
Inforai us about which attributes and skills of 
teachers are important in determining student 
performance. 

Studsring the meaning of teaching to faculty 
might be a somewhat easier task since the con- 
text for the research is the teacher's own work 
rather than the group of students taught. A wide 
variety of studies have elicited faculty attitudes on 
many social and political questions. Such studies 
help to understand something of the life and 
views of various groups of faculty, divided by 
discipline and institutional type as well as }yy 
demographic characteristics. Nonetheless, as 
pointed out by Blackburn (1986), studies that 
probe the attitudes of faculty toward the teaching 
role are scarce. Once a start has been made in 



acquiring a basic view, longitudinal studies will 
be needed. This is true because, as is the case for 
students, changes of emphasis in the multiple 
roles faculty perform and the historical or eco- 
nomic context of the times may result in different 
meanings of teaching for different cohorts. 

Considerably more Information is available 
regarding a few factors that influence teachers to 
be involved and productive. Studies of morale, 
productivity, job satisfaction, and time use, 
however, typically have been conducted without 
comparisons with other professional occupations. 
Finally, of course, because there are virtually no 
studies of the meaning of teaching, knowledge 
about job-related variables must be interpreted 
without the necessary context. 

In summary, the substantial basic research 
on the psychology of work in other fields has not 
been extended to the somewhat imlque role of the 
college teacher. Instead, basic researchers collect 
attltudinal data from faculty about political and 
social Issues while institutional research offices 
collect work-related demographics. Policy re- 
searchers at colleges, like those in broader set- 
tings, have little meaningful Information on which 
to draw but show increased receptivity to surveys 
that lack perspectives that might be gained from 
basic understanding of the human being as 
teacher. In such a situation, planned interven- 
tions to improve college teaching and learning 
focused on the teacher as actor may be inappro- 
priate. In the absence of criteria or due to the 
politiclzation of criterion research by stakehold- 
ers, evaluation research languishes. 
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Vl.The Organization of Postsecondary Teaching 
and Learning 



The quality of formal education depends on 
the organizations that support terchlng and 
learning. If wc seek ways to Improve learning. It 
Is reasonable to scrutinize the Institutions that 
foster student learning as a primary goal. How do 
these institutions promote or hinder student 
success? 

Through both observation and logical analy- 
sis, researchers have examined institutional 
functions and goals. To illustrate, from a socio- 
logical perspective, an early formtilation of the 
educational system included three major func- 
tions: instruction, cultural socialization, and 
selection (Parsons. 1959). Bowen. an economist/ 
educator, recognized three broad societal services 
provided by hi^er education; instruction, re- 
search and scholarship, and public service 
(1974). Finally, from an eclectic stance, research- 
ers have developed a detailed taxonomy of poten- 
tial higher education outcomes with five major 
cat^ories: economic outcomes; himian charac- 
teristic outcomes; knowledge, technology, and art 
form outcomes; resource and service provision 
outcomes; other maintenance and change out- 
comes (Lerming. Lee. Micek, & Service. 1977). 
Perhaps an additional and commonly overlooked 
goal must be added, that of institutional self- 
survival. Regardless of the classification system 
used, the tensions among these multiple goals 
and functions of higher education and the relative 
resources allocated to them are critical factors in 
all aspects of institutional performance. Asa 
result of these tensions, studies of colleges and 
universities as oiganlzations have been frequent 
but varied in approach. 

One approach to studying the question is to 
develop criteria forjudging the organizational 
effectiveness of postsecondaiy institutions in 
relation to one or more of the multiple goals. This 
type of analysis, however, is hindered by the fact 
that basic research developed in other types of 
organizations is often inappropriate to higher 
education. Although used by some state agen- 
cies, profit maigins. market share and similar 
concepts used to measure commercial and indus- 
trial success have few direct analogues in educa- 
tion. Other concepts developed to evaluate 
patron-client relationships (reputation, referrals, 
client accountability, client surveys) have been 
used by institutions or by external agencies, but 
the considerable suspicion ihese methods engen- 
der llm*t theii utility. The residue of the various 
research strategies is a persistent question: HTo 
whom is the college accountable: the student, the 



funding sources, or the broader society— or all of 
these?** 

A relatively recent approach to this problem 
is to examine institutional culture or climate. 
One such line of research, most often conducted 
by institutional researchers, has compared the 
perceptions of constituent campus groups with 
respect to institutional functioning or goal 
achievement. To the extent that there is a shared 
vision of oiganizational mission, whether a vision 
of diverse opportvmlty demanding student and 
faculty initiative or a vision of common values and 
purposes, the college Is seen as effective. This 
notion is reinforced among the public by research 
defining effective public schools as sharing norms 
of human concern and task orientation under 
strong leadership. 

Despite the diverse approaches to character- 
izing oiganizational effectiveness, there has been 
little attempt in higher education to link the 
various dimensions of this concept directly to 
teaching and learning (Peterson. 1986). Some 
believe such direct liiiks are impossible to ascer- 
tain, except perhaps when examining small 
institutional sub-imits oi specific academic 
practices. Thus, current approaches proceed by 
examining the influence that organizational 
characteristics exert indirectly through one or 
more mediators, e.g.. students, faculty, specific 
teaching and learning practices, curriculum 
development, or accountability mechanisms. 

Simultaneously, basic researchers are 
attempting to imderstand the characteristics of 
colleges as organizations while institutional 
researchers collect data to facilitate interlnstitu- 
tional comparisons. Occasionally, institutional 
researchers consider possible links between or- 
ganizational functioning and student learning, 
particularly as portrayed in measures of alumni 
satisfaction. The primary impetus for research, 
however, is being generated by policy researchers 
in response to public views that the links are 
strong. Furthermore, as statewide "megasystems" 
of universities emerge, the potential for new and 
broader (rather than narrower) definitions of 
educational organizations increase. Despite the 
intuitive appeal of organizational change as the 
vehicle for improving teaching and learning, the 
development of research models to test this 
potential relationship lies in the future. Repli- 
cable research at the institutional level is needed 
to pinpoint what aspects of organizational change 
are effective in improving what aspects of teach- 
ing and learning. 
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VII. Defining What is to be Learned 



A focus on what is to be learned in college 
rettuns this analysis to a point closely 
related to our original discussion of learning as a 
process. While the public continues to ask what 
has caused declines in standardized test scores, 
researchers may well ask about the validity of the 
measures. Perhaps declining scores are not 
indicative of a true decline In student learning. 
Rather, in a rapidly changing society, the shifts in 
scores may suggest that we arc not measuring 
what it is that sludents actually do leam. Some 
policy researchers have proposed that one way in 
which teaching anri learning might be improved is 
to articulate more clearly what students should 
leam in collies and universities and then de- 
velop valid mea'iures of that learning (NIE Study 
Group. 1984). As this strategy is contemplated, 
at least five questions must be addressed: What 
should students leam? Who should decide? 
Should all students leam the same things? How 
should we measure what has been learned? 
What is measurement likely to tell us about what 
interventions will improve learning? 

Although lists of desirable learning outcomes 
are seldom short, taking a broad view there are 
three primary competitors for the slot "most 
Important to be learned*: (1) conceptual and 
factual knowledge; (2) critical thinking a^id prob- 
lem-solving skills; and (3) professional or career 
skills. For some, the most serious problem with 
higher education is exemplified by the student 
with abimdant technical knowledge but who may 
not be well versed in humanities; for others it is 
the student who cannot analyze new material in- 
dependently, and for still others it is the student 
who has no obvious "marketable'* skills. The 
question of what students should leam and who 
should decide becomes a research question only 
after one accepts one of several prior premises. 
To cite only four of a potentially much larger set 
of such premises: (1) what should be learned Is a 
societal issue and in a democratic society the 
majority should decide; (2) what should be 
learned is a societal issue but the long range 
societal welfare demands that neutral and knowl- 
edgeable experts, rather than the general major- 
ity, should decide; (3) what should be learned Is 
an economic issue and the employment market- 
place should be aiilowed to determine what stu- 
dents choose; (4) what should be learned is an 
matter of individual choice and benefit. Clearly, 
as long as educators and the public approach 
what should be learned from these differing 
perspectives, the questions of what should be 



learned or who should decide are outside the 
arena of educational research. 

Setting difficulties in resolving the varying 
perspectives aside, the implications for teaching 
and learning of the chosen priorities for learning 
are far-reaching. If facts and concepts are impoi - 
tant, curriculum research should be aimed at de- 
signing courses and programs so as to make the 
information presented ea5>y for students to grasp 
and assimilate. If critical thinking is the major 
objective, courses and researchers should investi- 
gate how topics may be chosen and organized so 
that these skills are purposeful^ developed and 
practiced. If marketable skills are important, the 
implications for teaching may include both of 
these considerations as well as continual analysis 
of a changing emplosrment needs in a rapidly 
changing economic and technological world. 
Beyond these questions of strategy in choosing 
learning content, important research questions 
that emerge in such a volatile setting include 
considerations of whether any one of the goals 
automatically excludes the others. Finalty, to 
what extent can the three areas (and others, such 
as communication skills, value development, and 
aesthetic appreciation) be mutually interdepend- 
ent and reinforcing? 

Perennial discussion about what should be 
learned has tended to suppress research about 
various teaching and learning strategy .is and has, 
on occasion, politicized controlled curricular ex- 
perimentation. As a consequence of this knowl- 
edge gap in college curriculum development, 
decisions about what is to be learned are influ- 
enced and made at several levels: by federal and 
state funding initiatives or regulations, by em- 
ployers, by accreditors, by college programs, by 
families and, on a daily basis, by individual 
students, faculty members, and administrators. 
E^^en within the same college program some 
administrators and faculty members may advo- 
cate a broad variety of learning experiences while 
others espouse study of one area in considerable 
depth or a particular type of teaching system. 
Students, in turn, may disengage from this 
conflict and consider minimal demands or the 
futjre applicability of learning as primary. Rec- 
ognition of differing purposes, articulation of 
varied alms at each level of decision-making, 
principles of classroom autonomy, and a strong 
belief in individual choice have hampered basic 
research about what students study and leam. 

Basic research assessing what students 
leam tells us that students who have taken 
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particular college subjects know more about 
those subjects than students who have not 
studied them. Emerging basic and institutional 
research focusing on student-course-taking 
patterns should tell us what courses students 
are selecting or avoiding. Extrapolation of the 
"theory of involvement" discussed earlier leads us 
to believe that students will learn more thor- 
oughly what they see as interesting, engaging, 
useful, or attainable. Currently, policy research- 



ers who are weighing methods to improve teach- 
ing and learning have focused on these related 
propositions and suggest the collection of student 
outcome measures. If so construed, such data 
collection may be seen as evaluative research to 
confirm or deny these caveats. Models for re- 
search concerning what students can and should 
learn under given circumstances are needed to 
link emerging information back to improve the 
processes of teaching and learning. 
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VIII. Summary 



Proceeding from our own sense of the states 
quo rather than from any empirical sum- 
mary of ongoing research, we observed the follow- 
ing: 

1. Basic research on college student learning is 
r.dvaaclng rapidly through progress in 
cognitive psychology. At present, these 
findings are not frequentty field tested or 
translated Into practice. Better understand- 
ing of tlie learning process is not an impor- 
tant focus for other types of research. 

2. The entire field of research on college teach- 
ing is underdeveloped. While attempted Im- 
provements in practice proceed by trial and 
error in scattered settings, little basic knowl- 
edge about the process of teaching is avail- 
able to Inform us about the potential Impact 
of intervention through changes In the way 
teachers teach. 

3. An abundant literature on student charac- 
teristics dcscilbcs the ways In which stu- 
dents change during college, and the corre- 
lates of student success, at least as defined 
externally to the student. This descriptive 
and correlational research has reached a 
stage of development where colleges can 
readily collect and analyze their own data for 
policy analysis or for program evaluation. 
Only recently, however, has basic research 
been launched to explore the meaning of 
education to the student. Such studies, 
closely allied to developing psychological 
paradigms and ethnographic research meth- 
ods, are expensive and rare. 

4. Demographic and attitudinal descriptions of 
faculty members abound. Compared to the 
parallel database on students, this research 
lacks longitudinal studies and correlational 
studies Invol/ing variables directly concemed 
with the person as teacher. Without noting 
the superficiality of research on facult>\ 
policy researchers call on it for propositions 
that modify the context in which the faculty 
member performs the teaching role. 

5. Within the substantial amount of literature 
on organizations, colleges and universities 
have received their share of attention by both 
basic and institutional researchers. Within 
this research base, the connections between 
student learning and varied measures of 
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organizational eflectiveness have not been 
eflectlvely explored. New models are needed 
for research at all levels, particularly since 
some researchers advocate seeking meaning 
through the examination of institutional 
subcultures while policy initiatives increas- 
ingly move to a broader s^'stemwide or 
statewide context. 

6. ParUy because consensus is lacking about 
what students should learn, partly because 
of beliefs in individual choice, and partly 
because research has been politicized, there 
are few models to test the impact of the 
dilTerences between what students are 
supposed to learn and what they do leam 
imder varied circumstances. In this arena, 
keen interest among policy and evaluation 
researchers may stimulate more basic 
investigations. 

As a heuristic device, we separated each of 
four ways of approaching the task improving 
teaching and learning and each of four tjrpes of 
research that might provide enlightenment. It 
quickly became obvious that each Juncture at 
which teaching and learning might be improved is 
inextricably related to the others. One of the 
benefits of examining each as a discrete issue is 
that we are then able to see the relationships 
more clearly. For example, it became obvious in 
our discussion that the purposes for which 
students attend college (personal, social, cogni- 
tive, and vocational development) not only affect 
their learning but permeate societal debate about 
what they should leam. Similarly, it was difficult 
to talk of teaching without envisioning the 
learner. 

Because of these interrelationships, the 
research models used to investigate these issues 
are necessarily complex. Student outcomes are 
not the function of a single additive process: 
mode of learning + method of teaching + learner 
attributes + teacher attilbutes + organizational 
context = learning achievements. Any attempts to 
estimate such an equation would be foolhardy. 
Instead the models used for advancing knowledge 
must reflect the complexity of the questions, rec- 
ognizing both the interactions between elements 
and the existence of multiple points for interven- 
tion. Nor can it be assumed that interventions, 
such as those that might be recommended by 
policy researchers, are independent; their effects 
will be evident in several aspects teaching and 
learning. 
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While these relationships between teacher 
and learner, teaching and learning, goals and out- 
ccmcs arc coninioniy recognizcu, the connections 
between the types of research we have described 
are not so obvious. If, as sr ae assert, educa- 
tional research has little impact on practice, the 
reason may be that links among the various types 
of research, often undertaken Ity diverse agencies 
for varying purposes, arc weak or nonexistent. 
Earlier, in Figure 1. we diagrammed an ideal 
model in which each type of research would 
reciprocally inform the other types. Here we set 
forth some recommendations about how the 
reality of this situation could be brought closer to 
the ideal. 

1. Basic research that holds promise of improv- 
ing college teaching and learning needs 
greater support, broader field testing, and 
improved translation for the use of institu- 
tional researchers. It Is no secret that much 
of this research originated as psychologists 
explored various aspects of personality and 
cognition with the handiest subjects, college 
students. Colleges themsehres have never 
invested heavily In the research and develop- 
ment enterprise deliberately to improve 
teaching. Societal Interest, as well as insti- 
tutional self-interest, makes this a propitious 
time to foster greater amounts of such 
research. 

2. Institutional research, a little publicized 
aspect of university operation, typically has 
focused on aspects of organization most 
closely allied to funding, facilities and enroll- 
ment planning, systems operations, and 
report generating. In relatively few universi- 
ties are personnel in the Institutional re- 
search office either appropriately trained or 
inclined to apply basic research to the 



improvement of teaching and learning. In 
some universities, a separate office of faculty 
instructional development aJso exists. In 
these offices too, neither the origin of the 
developmental activity nor current expecta- 
tions are likely to foster research directly 
concerned with teaching and learning. It is 
time for these offices to broaden their mis- 
sion to include the translation and field 
testing functions as well as the training of 
faculty members to be classroom researchers 
(as suggested by Cross, 1986). 

3. Policy researchers need to weigh more 
heavily basic studies and related field tests, 
recognizing that simplistic alternatives based 
on superficial understanding are unlikely to 
provide long-range improvements. Even so. 
if the necessary developmental mechanisms 
for basic research and institutional field- 
testing do not exist, policy researchers can 
hardly be blamed for choosing among avail- 
able studies that are understandable and 
seem promising, 

4. Lastly, despite objections on the grounds of 
intrusion, both institutions and governmen- 
tal agencies need to sponsor carefully struc- 
tured evaluation research. Traditionally, 
universities have relied on sporadic efforts of 
a politicized committee system to collect 
descriptive data about teaching and learning 
and develop recommended changes. The 
evaluation research office within a university 
should have dual obligations: to examine 
the results of chosen policy altematives and 
to identify areas of need for new basic and 
institutional research. Such an office would 
complete the link in a systematic research 
enterprise that would at least come close to 
approaching the complexity of the problems 
by which it is challenged. 
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